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@ Locating bar code symbols. 



@ A bar code reader (10) Includes an optical system (26, 28) for storing a two dimensional Image in 
memory (32), which stored two dimensional image contains a bar code symbol. A method and apparatus 
is disclosed for detecting the location of the bar code image by computing the accumulated sum (64) of 
the products of the derivatives (62) of respective first and second scan lines (60) as a location score (68) 
for the image under consideration. The higher the location score, the higher the probabOity that the area 
under consideration contains a bar code image. Also, a method and apparatus is disclosed (Fig. 5B) for 
determining the fine orientation of a located bar code image by the cross-correlation of interpolated 
scan line data. The bar code image is filtered by shifting interpolated scan line data in accordance with 
the detected peak of the cross-correlation and combining the shifted scan line data. 
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This invention relates to the field of machine read- 
able symbols, and particularly to a method and 
apparatus for reading of bar code symt>ols. 

In our co-pending European patent application 
(published under the number EP-A 

) corresponding to United States application 
500,802 (Uoyd Wise, Tregear Case 34927) a bar 
code reader is disclosed which provides for high 
speed omnidirectional reading of multiple or stacked 
bar code symbols, or even damaged bar code labels, 
which may be at a random orientation, distance and 
relative motion with respect to the reader. 

A bar code Is a particular type of machine read- 
able symbol. A typical barcode Includes parallel solid 
lines, or t>ars, of varying width and spacing. The alter- 
nating light and dark areas defined by the bars and the 
spaces t)etween the bars, represent a digital code 
which serves to identity the content of the bar code 
symbol. After being read, the digital code is then 
directly translated to a sequence of alphanumeric 
characters and then by means of a data base, may be 
further translated to the common language descrip- 
tion of the item bearing the subject bar code label, 
along with other pertinent data, such as for example 
the current price of the item. 

A bar code may be read by scanning. Typically, 
a small spot of light is directed from a source of illumi- 
nation to the surface of the bar code. The reflected 
light is sensed by a photosensitive element The smalt 
illuminated spot of light is then swept across the bar 
code surtece, all the while sensing the intensity of the 
resulting reflected light Since light areas reflect more 
light than dailc areas, the reflected light intensity rep- 
resents the digital code which serves to Identify the 
content of the bar code symbol. 

In one type of bar code reader, a hand held laser 
or LED is used as the source of illumination, and the 
reader is manuallysweptacross the barcode surface. 
In a scanning type of bar code reader, the light source 
is stationary while the light beam is moved in a scan- 
ning pattern. In a particular type of bar code scanner, 
a laser beam is swept through a complex series of 
repetitive geometric patterns in order to provide for 
some degree of omnidirectional scanning. However, 
due to the limitations of laser type barcode scanners, 
it is difficult to obtain reliable consistent bar code read- 
ing, particutariy when used with damaged bar code 
labels. 

In another type of bar code reader, an image of a 
bar code is formed on an array of photosensitive ele- 
ments, and subsequently stored in a memory for 
further processing. However, in the latter type of prior 
art bar code reader, it has still been necessary to posi- 
tion and orient the bar code to the reader. 

in general, in the prior art, it is typically necessary 
for the operator to either orient the bar code, or other- 
wise position the bar code and/or the reader manually 
in order to achieve proper operation. 



The present invention Is embodied In a bar code 
reader in which bar codes are rapidly and reliably 
read. Furthermore, a bar code reader in accordance 
with the present invention provides for high speed 

5 omnkJirectlonal reading of multiple or stacked bar 
code symbols, or even damaged bar code labels, 
which may be at a random orientation, distance and 
relative motion with respect to the reader. 

The emtK)diment of the bar code reader In 

10 accordance with the present invention described 
below includes 1) means for capturing and storing a 
two dimensional image In memory storage, which 
stored image Includes a bar code symbol somewhere 
within the field of view, 2) detecting means for proces- 

15 sing the stored image for detecting a potential loca- 
tion, or locations, anywhere within the field of view of 
the stored image, each of which locations being likely 
to contain a bar code symbol, 3) orientation proces- 
sing means for detenmining the orientation of saki 

20 detected bar code symbol at said detected location 
likely to contain a bar code symbol, 4) filtering means 
for filtering said detected bar code symbol in a direc- 
tion perpendicular to said determined orientation of 
said detected bar code symbol in order to utilize the 

25 redundancy of the bar code symbology, and 5) means 
for scanning through said detected bar code symbol 
at a location corresponding to said detected potential 
location and at an angle substantially corresponding 
to said determined orientation of said detected bar 

30 code symbol. 

The present invention is applied in the at>ove 
embodiment and Is particulariy concerned with a 
method and apparatus for perfonming the second step 
in the above mentioned bar code reader, i.e. deter- 

35 mining which areas of the stored two dimensional 
image are the locations likely to contain a t>ar code 
symbol. 

To this end, the preferred practice of the inventton 
provides thatfiret, two parallel scan lines are selected. 

40 Then, the derivatives of thefiret and second scan lines 
respectively, are calculated. Thereafter, the point by 
point product of respective derivatives of said first and 
second scan lines is computed. An accumulated total 
of the sum of the respective products of derivatives of 

45 the firet and second scan lines Is computed as a loca- 
tion score which represents the relative probability 
that the area of the stored two dimensional image 
under consideration contains a bar code symbol. The 
higher the location score for given area, the more 

50 likely the area is to contain a bar code symbol. 

More speclficaliy, the approximate derivative of a 
scan line is calculated as the difference between adja- 
cent pbcel values. Since the bare of a bar code are 
black to white transitions, and vice versa, a scan 

55 across the bare will produce high magnitude differ- 
ence values, both positive and negative. It Is sugges- 
ted that the first and second scan lines be adjacent 
but not too dose. For example, it Is suggested that the 
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first and second scan lines be four scan lines apart 
in the presence of a bar code, the approximate deri- 
vative of the second scan line will produce similarhigh 
magnitude difference values, both positive and nega- 
tive and in the same sequence as for the fbst scan 
line. The product of the two approximate denvatives 
will be all high magnitude positive values since, for 
parallel bars, the high positive and high negative 
values will be aligned. In order to assure better align- 
ment at dight angles, and Improve processing speed, 
every other pixel value may be used in computing the 
approximate derivative. 

Another aspect of the present Invention applied to 
the bar code reader embodiment outlined above, is 
particularly concerned with a method and apparatus 
for performing the third step in the above mentioned 
bar code reader. I.e. determining the orientation of the 
detected bar code symbol at the detected location 
likely to contain a bar code symbol. 

To this end. the preferred practice of the invention 
provides tiiat first, a plurality of parallel scan lines in 
a given area is selected. Then, processing parallel 
scan lines in pairs, first and second scan lines are 
interpolated to provide a smooth curve of first and sec- 
ond interpolated scan line data. Thereafter, first and 
second interpolated scan line data are cross-corre- 
lated. The cross-correlation function is a measure of 
the similarity, or conrelation, between two curves as a 
function of the relative position of the two curves, i.e. 
as one curve is translated relative to the other curve. 
The peak of the cross-correlation function for the first 
and second interpolated scan line data represents the 
offset between the first and second scan lines. The 
detected position of the peak of the cross-correlation 
function and the distance between the first and sec- 
ond interpolated scan line data aro used to calculate 
the fine orientation, or angle, of the bars of the bar 
code symbol. 

More specifically, if the peak of cross-con^lation 
function is located at zero, then the first and second 
scan lines are exacfly aligned. In the latter case, the 
orientation angle of the bar code is zero, i.e. the bar 
code is perpendicular to the first and second parallel 
scan lines. 

In the more general case, the location of the peak 
of the cross-con*elation function represents tiie offset 
between the first and second scan lines. The calcu- 
lated offset IS used to shift the two scan lines into 
alignment Using tiie calculated offeet, which Is deter- 
mined from the located peak of the cross-conrelation 
function for each line pair, each scan line through the 
bar code is shifted Into alignment, which compen- 
sates for the angle between the scan lines and the bar 
code. The located peak of the cross-oorrelatton is also 
a measurement of the fine orientatton angle of tiie bar 
code symbol. After the scan lines are aligned, the bar 
code symbol Is filtered by computing the average 
value of the corresponding data points of the shifted 



and aligned scan line data. In the altemative, the 
median value of the corresponding data points of the 
shifted and aligned scan line data may be used to fflter 
the barcode image. 

5 In order to calculate the actual fine orientation 

angle of tiie barcode symbol, the position of the peak 
of the cross-correlation function Is used In conjunction 
with the known spacing between the first and second 
scan lines. In particular, the tangent of the angle of the 

10 bar code symbol is the ratio of the offset between the 
first and second scan lines to the distance t>etween 
the first and second scan lines. Thus, the fine orien- 
tation angle of the bar code symbol is the arctangent 
of the ratio of the calculated position of the peak of the 

IS cross-correlation function to the distance between the 
first and second scan lines. 

Rnally, using the computed fine orientation angle 
of the bar code symbol, successh^e partial scans 
taken along the computed fine orientation angle are 

20 concatenated to form a complete scan. 

The present invention and Its preferred practice 
will now be further described witii reference to the 
embodiment illustrated in the accompanying draw- 
ings, in which: 

25 Figure 1 is a block diagram, partially in flow chart 

fonm, indicating a method and apparatus in 
accordance with the present Invention; 
Figure 2 Is a block diagram of a system for a bar 
code reader In accordance with the present 
30 invention; 

Figure 3 Is a graphical representation of a two 
drmensbnal image area Illustrating individual 
cells used in determining location and orientation 
of a barcode symbol in accordance with the pre- 
ss sent Invention; 

Figure 3A is a representation of a portion of the 
image area of figure 3, which portion contains a 
bar code symbol; 

Figure 4 is a flow chart illustrating the control pro- 
40 gram for the ASIC controller of figure 2; 

Figures 5A and 5B show a flow chart illustrating 
the control program for the digital signal pro- 
cessor of figure 2; 

Figure 6A is a representation of a bar code sym- 
45 bol with two typical parallel scan lines, which may 
be utOized in conjunction wKh tiie embodiments of 
the present invention; 

Figure 6B illustrates the reflectance signals firom 
the two parallel scan lines of figure 6A; 

so Figure 6C represents the signal differences be- 

tween successive data points along each of the 
two respective scan lines of figure 6B; 
Figure 6D Illustrates the products of the signal dif- 
fences for each of the respective data points for 

55 the signal differences shown in figure 6C, and the 

sum total of all products of the signal differences 
along two parallel scan lines utilized in conjunc- 
tion witii the present invention; 
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Rgure 7A is a representation of a black to white 
transition with two typical parallel scan lines, 
which may be distinguished from a bar code sym- 
bol in conjunction with the present invention; 
Rgure 7B illustrates the reflectance signals from s 
the two parallel scan lines of figure 7A; 
Rgure 7C represents the signal differences be- 
tween successive data points along each of the 
two respective scan lines of figure 7B; 
Figure 7D Illustrates the products of the signal drf- io 
ferences for each of the respective data points for 
the signal differences shown In figure 7C, and the 
sum total of all products of the signal difFerences 
along two parallel scan lines; 

Figure 8A is an image of a bar code symbol at an is 
angle to the direction of scan with a portion of the 
scanned area indicated; 

Figure 8B illustrates the reflectance signal from 
one scan line of the scanned area Indicated in fig- 
ure 8A; 20 
Figure 8C illustrates the scan line of figure 88 
after processing by interpolation; 
Figure 80 shows one interpolated scan line and 
another interpolated scan line, four scan lines 
apart 25 
Figure 8E shows eight Interpolated scan lines 
which have been shifted respectively Into align- 
ment; 

Figure 8F shows the average of the eight interpo- 
lated and shifted scan lines of figure 8E; so 
Rgure 8G is a binary signal representation of the 
wavefonm of figure 8F using the overall signal 
average as the binary threshold value; 
Figure 9A is the cross-correlation function of the 
interpolated first and second scan lines of the per- 35 
tion of the scanned area in figure 8A; 
Figure 9B is a family of cross-correlation curves, 
each resulting firom cross-correlating the first 
interpolated scan line with successh^e interpo- 
lated scan lines of the portion of the scanned area 40 
in figure 8A; 

Figure 9C shows the peak values of the cross- 
conrelation function for each interpolated scan 
line compared to the first interpolated scan line for 
the portion of the scanned area indicated in figure 45 
8A; and 

Figure 10 is an illustration of a bar code symbol, 
depicting the manner in which overlapping partial 
scans are concatenated to form a complete scan. 
A brief overview of a bar code reader in accord- so 
ance with the present invention is shown in figure 1. 
An Image acquisition system 14 which Includes the 
necessary optical and photosensitive elements, cap- 
tures an image of the reader'sfield of view, which cap- 
tured image may contain a bar code label 12. 65 

Once the image Is acquired in memory, means 
are provided for bar code image location and coarse 
orientation 1 6. Together, image acquisition 1 4 and bar 



code image location and orientation 16 comprise the 
portion of the present bar code reader which serves 
to generally locate a bar code within a field of view. 

After the bar code image is located within the field 
of view and its coarse orientation determined, means 
1 8 are provided for determining the fine orientation of 
the bar code. Having located the bar code and deter- 
mining Its fine orientation, means 20 for fStering the 
barcode, are provided. Thereafter, barcode scanning 
22 is perfonmed. The operation of determining the fine 
oiientetion 18, bar code filtering 20, and bar code 
scanning 22, together comprise the portion of the pre- 
sent bar code reader which serves to "^scan" a bar 
code once having been located within a field of view. 
After bar code scanning, a decoder 23 well known to 
those skilled in the art, provides the decoded t>arcode 
label output 24. 

The operation of "scanning a bar code", as used 
In the prior art, relates to sweeping an lliumtnated spot 
across a bar code. As used herein, with respect to the 
present invention, the operation of "scanning a bar 
code" means to extract from Image memory storage, 
sequential values derived from said image memory 
storage corresponding to reflectivities along a sweep 
traversing the t>ar code. 

A preferred hardware embodiment of the present 
invention is shown in figure 2. An optical system 26 is 
coupled to an image sensor array 28. The output of 
the image sensor array 28 is converted from analog 
to digital in A/D converter 30. and stored in a first 
memory 32. The first memory 32 Is preferably a 
dynamic random access memory (DRAIM). A control- 
ler 34 which may be an application specific integrated 
circuit (ASIC) controls the image acquisition system 
so as to capture and digitize an image and store it in 
DI^AM 32. The ASIC controller 34 also perfomfis sev- 
eral other processing tasks under the control of a digi- 
tal signal processor 38. Digitel s^nal processor 38 is 
typically a high speed microprocessor such as the 
ADSP-2101 available from Analog Devices, Nor- 
wood, Mass. The memory space for digital signal pro- 
cessor 38 is both ROM for program storage and a 
stetic random access memory 42 (SRAM) for Image 
processing storage. Portions of the stored image 
memory in DRAM 32 are transfierable to SRAM 42 
under the control of ASIC controller 34. Finally, an 
input terminal 40 is coupled to the input of digital sig- 
nal processor 38, and output terminal 44 is coupled to 
a decoder 23 which is coupled to the output of digitel 
signal processor 38. 

In operation, a bar code read is initiated by an 
input signal on tenminal 40 to digital signal processor 
38. Responsive to the control outputs of digital signal 
processor 38. ASIC controller 34 acquires an image 
for storage in DRAM memory 32. Also responsive to 
the control outpute of digitel signal processor 38, 
ASIC controller 34 processes the stored inrtage in 
DRAM 32 so as to determine the potential location or 
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locations which are IQceiy to contain a bar code sym- 
bol. For location processing, the Image stored in 
DRAM 32 Is divided into smaller areas, or cells, and 
a location score Is assigned to each cell. The higher 
the location score fbra given celt, the more likely Is the 
cell to contain at least a partial bar code symbol. 

When the ASIC controller 34 has completed its 
location scoring task, digital signal processor 38 
examines the resulting scores and commands the 
ASIC controller 34 to transfer those image areas of 
interestfrom DRAM 32 to SRAM 42. Digital signal pro- 
cessor 38 thereafter processes the partial image in 
SRAM 42 to determine the orientation of the stored 
bar code image, to filter the oriented bar code image 
along a direction perpendicular to the determined 
orientation, and to scan the oriented and filtered t>ar 
code Image. After all areas of interest have been 
transferred from DRAM 32 to SRAM 42 and proces- 
sed by digital signal processor 38, a complete bar 
code output scan is provided to decoder 23 which pro- 
vides a decoded bar code label output at terminal 44. 
Alternatively, the function of decoder 23, which may 
have serial or parallel output, may be included in the 
program of dlgitel signal processor 38. 

On the other hand, if by examination of the loca- 
tion scores, no bar code was found in the stored 
Image in DRAM 32, then digttal signal processor 38 
through ASIC controller 34 may command the optical 
system 28, the image sensor array 28 and the A/D 
converter 30 to acquire another image in DRAM 32 for 
processing. The process of acquiring and processing 
images may continue until a bar code symbol Is suo- 
cessfully scanned. 

The organization of the stored DRAM image area 
48 is shown in figure 3. The image sensor array 28 
(figure 2) has 768 pixels in the horizontal direction and 
576 pixels in the vertical direction. A suitable image 
sensor for use with the present invention is the MOS 
image sensor array 98268 available from Hitechi Cor- 
poration. The image area 48 is conceptually divided 
into cells, such as cell 49. Specifically, the image area 
48 is divided into 24 cells In the horizontal direction 
and 72 celts in the vertical direction, with each cell 
being 8 by 32 pixels. That is, each celt has 8 scan 
lines, with each scan line having 32 pixels. 

The Image area 48 is dWided into cells in each of 
four directions. That is, image area 48 is divided Into 
horizontal cells such as cell 50. However, image area 
48 IS also divided vertical cells such as cell 52. Simi- 
lariy. Image area 48 Is dh^ided into cells along a rising 
diagonal i.e. 45 degrees such as ceil 56. Finally, 
image area 48 is divkfed into cells along a falling 
diagonal i.e. 135 degrees such as cell 54. Using four 
directions of scan lines penmits the location process 
to also determine the coarse orientation of the located 
bar code image in the same operation. 

For purposes of illustration, figure 3A shows a bar 
code symt>ol somewhere within the field of view of 



image area 48 and oriented 14 degrees off the vertical 
direction* A ^Ical vertical cell 52 is shown superim- 
posed over a portton of bar code symbol 58. 

The portion of the program of the ASIC controller 

5 34 (figure 2) for detenminlng the location or locations 
likely to contein a bar code 8ymt>ol is shown In the flow 
chart of figure 4. For a given cell in image area 48, the 
process uses two scan lines, I.e. scan line A, and scan 
line B. Specifically, scan line A is the fast of the e^ht 

10 scan lines of a given cell, and scan line B Is the fifth 
scan line of a gh^en cell. After entering the location 
program, the approximate derivative of scan line A, 
and the approximate derivative of scan line B, are cal- 
culated at step 60. For this purpose, a derivative is 

IS approximated by talcing the difference between any 
two consecutive pixels. In order to speed up the pro- 
cess of taking an approximate derivative, every other 
pixel Is used in the calculation, i.e. Instead of using all 
32 pixels across a scan line of a given cell, every other 

20 pixel i.e. 16 pbcels are used to approximate a deriva- 
tive. 

After finding the approximate derivatives at each 
point of scan line A and scan line B at step 60, the 
point by point product of both derh/atives is calculated 

25 at step 62. Thereafter, the sum of the producte of deri- 
vatives is accumulated at step 64. This process of 
accumulating the sum of the product of derivatives 
continues until all the pointe of scan lines A and B are 
completed for this cell at step 66. At this point, the 

30 accumulated product of derivatives constitutes the 
location score for this particular cell. The location 
score is then stored in SRAM at step 68. The program 
increments to the next cell In the image area at step 
70. The process of computing location scores con* 

35 tinues from cell to cell until the end of the Image area 
is detected at step 72, and the program is exited. 

The process of computing a location score for a 
cell Is illustrated In figures 6A through 6D. In figure 6A, 
scan line A and scan line B are shown at a slight angle 

40 across a portion of a bar code symbol. Figure 6B 
shows the reflectence signals at approximately 1.5 
pixels per nanrow bar for both scan line A and scan 
line B. The date pointe are simply connected by 
straight lines. Rgure 6C shows the result of teking the 

45 difference between successive date pointe along 
scan line A and successive date pointe along scan 
line B to produce an approximate derivative shown as 
delte scan line A and delte scan line B, respectively. 
Figure 6D shows the product of each date point along 

so delte scan line A and the corresponding date point 
along delte scan line B. Thus, each score In figure 6D 
for each date point is the product of the approximate 
derivatives of each respecthre date point of scan line 
A and scan tine B. Adding up the sum of the deriva- 

55 tives produces a location score equal to 810, whrch is 
a relatively high score because scan line A and scan 
line B are directly through a bar code symbol. 

To illustrate the ability of the locatton algoritiim to 
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distinguish barcodes from simple transitions between 
black and white areas, figures 7A through 7D Indicate 
the corresponding location score for a simple black to 
white transltk>n. Figure 7A shows an image with a 
black to white transition with two scan lines, scan line s 
A and scan line B therethrough. Figure 7B shows the 
reflectance signals for scan line A and scan line B. 
Figure 7C shows the approximate derivative or delta 
scan line A and delta scan line B, while figure 7D 
shows the sum of the derivatives for each point on io 
both scan line A and scan line B. The resulting loca- 
tion score of 57 from figure 7D for the Image in figure 
7A Is considerably less than the location score of 810 
for the bar code in figure 6A. 

The program flow chart for the digital signal pro- 16 
cesser 38 in figure 2, is shown in figures 5A and 5B. 
Responsive to an input signal on terminal 40 of figure 
2, to initiate a bar code read, the digital signal pro- 
cessor 38 enters the program as shown In the flow 
chart of figure 5A The first ste p 74, Is to command the 20 
ASIC controller to capture the Image area to DRAM. 
Once the image area is captured, the next step 76 is 
to command the ASIC controller to perform the bar 
code location algorithm (in accordance with the flow 
chart of figure 4, discussed above) for one direction 25 
Le. the horizontal direction. As the location algorithm 
is perfonmed for all cells in the horizontal direction in 
image area 48, the ASIC controller stores the results 
in SRAM. Each cell score, is an indication of the likeli- 
hood of bar code activify. The complete set of scores 30 
for a given direction fomis a map of the likely regions 
of bar code a^ivity. This process is repeated for all 
four db*ections l.e. location scores for a vertical scan 
are computed and stored in SRAM thorough program 
loop 80; location scores for a rising diagonal scan, Le. 36 
a 45 degree scan, are computed and stored in SRAM 
thorough program loop 82; and location scores for a 
falling diagonal scan, i.e. a 135 degree scan, are com- 
puted and stored In SRAM thorough program loop 84. 

Once the cell activity score map for a particular 40 
direction has been computed and stored in SRAM, the 
d^ital signal processor program determines whether 
or not bar code activity Is present at step 78. For this 
purpose, a simple threshed may be utilized, examin- 
ing all location scores that exceed a given threshold. 4S 
If no score exceeds a given threshold, then no bar 
code activity is found, and the program repeats start- 
ing from step 74 in which the ASIC controller captures 
a new image area to DRAM. However, if bar code 
acth/lty is detected at step 78, the subsequent digital so 
signal processor program. In accordance with the flow 
chart of figure 5B, proceeds to orient, filter, and scan 
the located bar code. 

The first step is to determine from the location 
scores stored in SRAM, the center of the region of bar ss 
code activity, and the likely horizontal and vertical 
extent of such activity, at step 86. The approximate 
center and extent of bar code activity may be deter- 



mined by region growing applied to the cell activity 
score map. Region growing Is a common image pro- 
cessing teskto identity a particular region of an overall 
image which particular region possesses a specific 
characteristic. In this case, large values. Region grow- 
ing Is a technique welt known to those skflled in the art 
of image processing, and Is disclosed In "MATRIX 
STRUCTURED IMAGE PROCESSING" by 
Dougherty and Giardina, published 1987 by Prentice- 
Hall Inc, Engiewood Clifte, New Jersey 07632. 

After the region of interest has been determined, 
the digital signal processor commands the ASIC con- 
troller to transfer the Image area containing bar code 
activity from DRAM to SRAM at step 88. SRAM mem- 
ory space is generally smaller than DRAM memory 
space, and typically represents a few percent of the 
totel Image area stored in DRAM. Although SRAM is 
generally faster than DRAM, the use of a relatively 
smaller SRAM is more economical since the cost of 
SRAM Is typically more than DRAM. Also, the area of 
the image stored in SRAM may or may not be related 
to the size of the cell areas from the DRAM image 
memory. Due to the smaller size of the SRAM, the lat- 
ter may hold only a portion of a bar code, in which 
case processing steps are repeated for partial scans 
and the partial scans later combined to form a com- 
plete scan. 

Once the image Is transferred to SRAM memory, 
the digital signal processor interpolates each of the 
scan lines of date for a given Image area of Interest 
at step 90. The process of interpolation Is well known 
to those skilled in the art of digital signal processing, 
and Is described by Peled and Liu in "DIGITAL SIG- 
NAL PROCESSING theory, design, and implemen- 
tetion", published 1976 by John Wiley and Sons. 
Interpolation Increases the effective sampling rate of 
the scan line date by fitting the best curve to the date 
witii frequencies below the Nyqulst limit 

The bar code Image is initially sampled at about 
1 .5 pixels per narrow bar. To create a smoother curve, 
the signal is upsampled by four times. In simple terms, 
rather than connecting the date pointe by straight 
lines, additional date pointe are added k>etween the 
actual date pointe to form a smoother curve. 

After interpolating each of the scan lines at step 
90, the first scan line of a given cell Is cross-correlated 
with successive adjacent interpolated scan line date 
as Indicated in step 92. Cross^orrelation provides a 
measure of the similarity, or match, between two cur- 
ves. Techniques for cross-correlating two signals are 
well known to those skilled in the art and a discussion 
of cross-correlation may be found In ""DIGITAL PRO- 
CESSING OF SPEECH SIGNALS" by Rablner and 
Schafer published 1978 by Prentiss Hall, Engiewood 
Clfffs, NJ 07632. 

Successive cross-correlation between adjacent 
interpolated scan line date provides a means to deter- 
mine the fine orientetion of tiie bar code symbol also 
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at step 92. The detected fine orientation of the bar 
code is derived from the difference betv/een the aver- 
age peaks of successive cross-correlations between 
adjacent interpolated scan lines. The position of the 
peak of the cross-correlation function of two scan 5 
lines represents the amount one scan ilne of data 
must be shifted in order to provide the best alignment 
with the other scan line of data. Calculation of the 
actual angle of the bars is discussed below In relation 
to figure 9A through figure 9C. io 

After the fine orientation of the barcode is known, 
each interpolated scan line data is shifted into align- 
ment at step 94. After the interpolated scan line data 
has been shifted into alignment, the average of all 
scan lines is computed. At this point, the bar code is 
symbol may be decoded into a partial bar code scan 
at step 94. 

The partial bar code scan is stored at step 94, and 
the next stored region of interest is detenmined at step 
96. That is, the next area of Interest which is likely to 20 
contain a bar code image is then transferred from 
DI^M to SRAM at step 88. The process of interpo- 
lation and cross-correlation is repeated until another 
partial bar code scan, representing an adjacent image 
area of interest, is stored. 25 

Once all of the stored regions containing bar code 
activity have been scanned, the partial scans are con- 
catenated, or connected to form a complete scan at 
step 98. Rnally, at step 98 the output scan Is forwar- 
ded to a decoder, known to those skilled in the art, for 30 
converting the complete concatenated barcode scan 
into a sequence of alphanumeric characters which 
represent the content of the bar code. 

Figures 8A through 8G and figures 9A through 9C 
illustrate the processes for detecting fine orientation, 35 
filtering and scanning of a bar code that has been 
located in a given cell. Specifically, figure 8A Illus- 
trates a vertical cell 52 consisting of 8 scan lines 
superimposed over a portion of a bar code label 58. 
The poor appearance, or spottiness of tiie bars is 40 
actually representative of the condition of many prin- 
ted bar code labels encountered in practice. 

Figure 8B shows the 32 pixels of the first scan line 
of cell 52 connected by sh^ight lines. FHgure 8C 
shows the same 32 data points after interpolation, or 4S 
upsampling by four times. Figure 8D shows one 
upsampled scan line, and another upsampled scan 
Ilne which Is 4 scan lines away. It is evident there Is 
an ofteet between the two waveforms. This offset is 
indicative of the orientation offiset of the bars. so 

Although the offset is visibly apparent in figure 
8D, It is necessary to compute the magnitude of tiie 
offset. I.e. the actual orientation angle of the bars. The 
cross conreiation function is well suited for this task. 

Figures 9A tiirough 9C illustrate ttie process of ss 
determining the fine orientation of the bar code sym- 
bol. Figure 9A shows the cross-correlation function of 
the first and second scan lines of the sampled signal. 



Note that the peak is at a lag of about minus one. Thte 
means that over a distance from one scan line to the 
next, the waveform is shifted one upsampled pbcel, or 
one fourth of an original pbcel. This yields a bar code 
slope of one fourth, or 0.25, which cornesponds well 
with the measured slope of about 14 degrees, since 
the arctangent of 0.25 equals 14.036 degrees. 

Figure 9B shows a family of cross-correlation cur- 
ves. Each curve is the result of cross-correlating the 
first scan line with the scan line successively furtiier 
away. Note that the peaks step over extremely con- 
sistently by one for each curve. By using Interpolation, 
it is possible to find the position of a peak in the cross- 
correlation function to fractional pbcel accuracy. Fig- 
ure 9C is a pk>t of the crose-conreiation function for 
each scan line compared to the first scan line of the 
given area of interest. Note that the calculated peak 
values lie almost perfectly along a straight line, the 
slope of which represents the fine orientation angle of 
the bar code symbol. In general, not all of the peak 
values may lie on a straight line. In which case the 
average slope may be taken to represent the fine 
orientation of the bar code symbol. 

Once the fine orientation of the bars is known, 
each of the interpolated scan line data is shifted into 
alignment as shown in figure 8E, and the average 
value taken as shown In figure 8F. Taking the average 
of oonresponding sample points from the shifted lines 
of Interpolated scan line data, provides a simple 
approach to bar code filtering. Averaging effectively 
filters perpendicular to the orientation of the bar ccxde. 
In the alternative, the median value of each data point 
could be used to reduce the effect of occasional mis- 
sing pieces of the bar code label. That is, a white spot 
on a black bar effects the median data value less titan 
the average data value. Another approach Is to take 
a weighted average based on cross-correlation 
scores to provide better rejection of pooriy correlated 
scan line data. In the latter case, those interpolated 
scan lines that correlate well with each other would 
count more heavily in flie average, while those Inter- 
polated scan lines which cross-correlate pooriy would 
weight the average correspondingly less. 

As used herein, "shifting** scan line data includes 
both actual shifting of scan line data within the image 
memory as well as virtual shifting of scan Ilne data by 
the use of an offiset vector to t>e added to the location 
of sequential values extracted from said memory. 

It is further noted that t>ar code fine orientation 
may be achieved by cross-correlation of selected 
pairs of scan line data alone, without interpolation of 
scan line data if there are sufficient data points, or 
pixels per narrow bar. Othenvlse, Interpolation is used 
to generate the additional data points for the cross- 
correlation to be meaningful. Finally, in shifting scan 
lines into alignment, all successive scan line data may 
be correlated to a single reference line, or In the alter- 
native, successive scan line data may be conrelated 
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In line pairs and not referenced to a single scan line. 

The aggregate waveform in figure 8F Is then con- 
verted to a binary value waveform as shown in figure 
8G using the overall signal aveiage as the blnaiy 
threshold. The zero level of the wavefonm in figure 8G 5 
corresponds to the black level of the bar code in figure 
8A, whOe the one level corresponds to the white level. 

Thus, a partial scan of the bar code shown In fig- 
ure 8A corresponding to the cell 52 has been peifor- 
med. Figure 10 shows how successive partial scans io 
100, 102 and 104 nuay be concatenated to form a 
complete scan of bar code 58. The partial scans over- 
lap each other so that no bar code data Is lost The 
successive partial scans are taken in steps along an 
angle corresponding to the measured fine orientation is 
of the bars. That Is, since the fine orientation of the 
bars is 14 degrees, a staircase of partial scans along 
a 14 degree angle off the vertical. Is constructed In 
order to acquire partial scans which can be concate- 
nated Into a complete scan of the bar code label. 20 

Thus, a bar code reader has been disclosed 
which is capable of reading a bar code symbol con- 
tained anywhere within the field of view of an Image 
area In an omnidirectional manner. Although the 
embodiment disclosed suggests the use of an area 2S 
image capture device, it will be appreciated that a 
linear image capture device as may be used with a 
moving conveyor belt, may also be used. 



Claims 



30 



1. In a bar code reader, a method for detecting the 
location of a bar code symbol comprising: 

capturing a two dimensional Image for 35 
storage in a memory, said stored two dimensional 
image containing an Image of a bar code symbol 
anywhere within the field of view of saki stored 
two dimenstonal image; 

approximating the derivative of a first scan 40 
line in a given area of said stored two dimensional 
Image; 

approximating the derivative of a second 
scan line substantially parallel to sakl first scan 
line in said given area of said stored two dimen- 45 
slonal image; 

multiplying said derivative of said first scan 
line and said derivative of said second scan line 
respectively to obtain a product of said derivative 
of said first scan line and said derivative of said so 
second scan line respectively; and 

accumulating the sum of the respective 
products of said derivative of said first scan line 
and said derivative of said second scan line to 
provide a location score for said stored two 55 
dimensional image, wherein said location score 
represents the relative likelihood that said given 
area of said stored two dimensional image con- 



tains a bar code image. 

2. A method In accordance with claim 1 , for detect- 
ing the location of a bar code symbol, wherein 
said steps of approximating the derivatives of 
said first and second scan lines respectively com- 
prises: 

subtracting a previous pbcel value from a 
present pbcel value along said first scan line to 
determine the approximate derivative of said first 
scan line; and 

subtracting a previous pbcel value from a 
present pbcel value along said second scan line to 
detenrtine the approximate derivative of said sec- 
ond scan line. 

3. A methcxi in accordance wfth daim 1 or 2, for 
detecting the location of a bar code symbol further 
comprising: 

determining whether said location score 
corresponding to said given area exceeds a pre- 
determined threshold, 

wherein said location score exceeding 
said predetermined threshold is an Indication that 
said given area of said stored two dimensional 
image contains a bar code Image. 

4. A method in accordance with claim 1 or 2, for 
detecting the location of a bar code symbol further 
comprising: 

storing respective location scores for a 
plurality of areas of said stored two dimensional 
image; and 

determining by region growing, which of 
said plurality of areas of said stored two dimen- 
sional image have respective location scores 
which correspond to a regton which includes said 
located barcode Image. 

5. In a bar code reader, a method for determining the 
orientation of a bar code symbol comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; 

interpolating a first scan line in a given 
area of said stored two dimensional image; 

interpolating a second scan line substan- 
tially parallel to said first scan line In said given 
area of said stored two dimensional image; 

calculating the oross-correiation function 
of said interpolated first scan line data and sakl 
interpolated second sc^an line data; and detecting 
the peak of said cross-correlation function of said 
first and second interpolated scan line data, whe- 
rein tiie position of said peak of said cross-corre- 
lation function of said interpolated first and 
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second scan line data corresponds to the orien- 
tation of said bar code image. 

6. A method in accordance vwth daim 5, further com- 
prising: 

shifting said interpolated second scan line 
data so as to be aligned with said interpolated first 
scan line data in accordance with said detected 
peak of said cross-conretation function of said 
interpolated first and second scan line data. 

7. A method in accordance with claim 5, for deter- 
mining the orientation of a bar code symbol 
further comprising: 

interpolating a plurality of scan lines In said 
given area of said stored two dimensional image; 
and 

calculating the respective cross-corre- 
lation function of selected pairs of interpolated 
scan lines from said plurality of interpolated scan 
lines. 

8. A method in accordance with daim 7, further com- 
prising: 

shifHng said interpolated plurality of scan 
tine data respectively so as to be aligned. 

9. A method in accordance with daim 8, further com- 
prising: 

filtering said bar code image by taking the 
average of corresponding data points from said 
plurality of shifted and interpolated scan line data. 

1 0. A method in accordance with daim 8, further com- 
prising: 

filtering said bar code image by taking the 
median of corresponding data points of said 
plurality of shifted and interpolated scan line data. 

1 1 . A method in accordance with daim 8, further com- 
prising: 

filtering said bar code Image by taking the 
weighted average of conresponding data points of 
said plurality of shifted and interpolated scan line 
data, said average being weighted according to 
the magnitude of said cross-con^lation function 
between said plurality of said respective interpo- 
lated scan line data and said plurality of interpo- 
lated first scan line data. 

12. A method in accordance with daim 7 or 8, further 
comprising: 

filtering sakl bar code image by combining 
conresponding data points of said shifted and 
Interpolated plurality of scan line data. 

13. A method In accordance with daim 12, further 
comprising: 



converting said fQtered bar code Image to 
a binary function using the average value of said 
combined shifted and Interpolated plurality of 
scan line data as the binary threshold value. 

5 

14. In a bar code reader, an apparatus for detecting 
the location of a bar code symtKil comprising: 

means for capturing a two dimensional 
image for storage In a memory, said stored two 

10 dimensional image contaunlng an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; 

means for approximating the derivative of 
a first scan line in a given area of said stored two 

IS dimenstonal image; 

means for appraxffnating the derivative of 
a second scan line substantially parallel to said 
first scan line in said given area of said stored two 
dimensional image; 

20 means for multiplying said derivative of 

said first scan line and said derivative of said sec- 
ond scan line respectively to obtain a product of 
said derivative of said first scan line and said deri- 
vative of said second scan line respectively; and 

25 means for accumulating the sum of the 

respective products of said derivative of said first 
scan line and said derivative of said second scan 
line to provide a location score for said stored two 
dimensional image, wherein said location score 

30 represents the relative likelihood that said given 
area of said stored two dimensional image con- 
tains a bar code image. 

15. An apparatus In accordance with daim 14, for 
35 detecting the location of a bar code symbol, whe- 
rein said means for approximating the derivatives 
of said first and second scan lines respectively 
comprises: 

means for subtracting a previous pbcel 
40 value from a present pixel value along said first 

scan line to determine the approxbnate derivative 
of sakl first scan line; and 

means for subtracting a previous pbcel 
value from a present pixel value along said sec- 
45 ond scan line to detemrtine the approximate deri- 
vative of said second scan line. 

16. An apparatus In accordance witii daim 14 or 15, 
for detecting the location of a bar code symbd 

so further comprising: 

means for determining whether said loca- 
tion score corresponding to said given area 
exceeds a predetenmined threshold, 

wherein said location score exceeding 
55 said predetermined threshold is an indication that 

said given area of said stored two dimenstonai 
image contains a bar code image. 
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17. An apparatus In accordance with claim 14 or 15, 
for detecting the location of a t>ar code symbol 
further comprising: 

means for storing respective location 
scores for a pturalHy of areas of said stored two s 
dimensional Image; and 

means for determining by region growing, 
which of said pluraiity of areas of said stored two 
dimensional image have respective location 
scores which correspond to a region which io 
includes said located bar code image. 

18. in a bar code reader, an apparatus for determin- 
ing the orientation of a bar code symbol compris- 
ing: 15 

means for capturing a two dimensional 
image for storage In a memory, said stored two 
dimensional Image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; 20 

means for interpolating a first scan line in 
a given area of said stored two dimensional 
image; 

means for Interpolating a second scan line 
substantially parallel to said first scan line in said 2S 
given area of said stored two dimensional image; 

means for calculating the cross-correlation 
function of said interpolated first scan line data 
and said interpolated second scan line data; and 

means fordetecting the peak of said cross- 30 
conrelation function of said first and second inter- 
polated scan line data, wherein the positton of 
said peak of said cross-correlation function of 
said interpolated first and second scan line data 
conresponds to the orientation of said bar code 35 
Image. 

19. An apparatus in accordance with claim 18, further 
comprising: 

means for shifting said Interpolated sec- 40 
ond scan line data so as to be aligned with said 
interpolated first scan line data In accordance 
with said detected peak of said cross-con'elation 
function of said interpolated first and second scan 
line data. 45 

20. An apparatus In accordance with claim 18, for 
determining the orientation of a bar code symbol 
further comprising: 

means for Interpolating a plurality of scan so 
lines in said given area of said stored two dimen- 
sional image; and 

means for calculating the respective 
cross-correlation function of selected pairs of 
interpolated scan lines from said plurality of said 55 
Interpolated scan lines. 

21. An apparatus In accordance with daim 20, further 



comprising: 

means for shifting said interpolated 
plurality of scan line data respectively so as to be 
aligned. 

22. An apparatus In accordance with daim 21, further 
comprising: 

means for filtering said bar code image by 
taking the average of corresponding data points 
from said plurality of shifted and interpolated scan 
line data. 

23. An apparatus in accordance with dabn 21 . further 
comprising: 

means for filtering said bar code image by. 
taking the median of corresponding data points of 
said plurality of shifted and interpolated scan line 
data. 

24. An apparatus in accordance with daim 28, further 
comprising: 

means for filtering said bar code image by 
taking the weighted average of corresponding 
data points of said plurality of shifted and interpo- 
lated scan line data, said average being weighted 
according to the magnitude of said cross-conra- 
lation function between said plurality of said res- 
pective interpolated scan line data. 

25. An apparatus In accordance with claim 20 or 21, 
further comprising: 

means for filtering said bar code image by 
combining conresponding data points of said shif- 
ted and interpolated plurality of scan line data. 

26. An apparatus In accordance with daim 25, further 
comprising: 

means for converting said filtered t>arcode 
image to a binary function using the average 
value of said combined shifted and interpolated 
plurality of scan line data as the binary threshold 
value. 

27. in a barcode reader, a method for determining the 
orientation of a bar code symbol comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; 

selecting a first scan line In a given area of 
said stored two dimensional image; 

selecting a second scan line substantially 
parallel to said first scan line in said given area of 
said stored two dimensional image; 

calculating the cross-correlation function 
of said selected first scan line and said selected 
second scan line; and 
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detecting the peak of said cross-corre- 
lation function of said first and second selected 
scan lines, wherein the position of said peak of 
said cross-correlation function of said selected 
first and second scan lines corresponds to the 
orientation of said bar code image. 



weighted average of corresponding data points of 
said plurality of shifted and selected scan lines, 
said average being weighted according to the 
magnitude of saki cross-correlation function be- 
tween said plurality of said respecth^e selected 
scan lines and said plurality of selected first scan 
lines. 

34. A method in accordance with claim 29 or 30, 
further comprising: 

filtering said barcode Image by combining 
corresponding data points of said shifted and 
selected plurali^ of scan lines. 



35. A method in accordance with claim 34, further 
comprising: 

converting safd filtered bar code Image to 
a binary function using the average value of sakI 
5 contbined shifted and selected plurality of scan 

lines as the binary threshold value. 

36. In a bar code reader, an apparatus for determin- 
ing the orientation of a bar code symbol compris- 
ing: 

means for capturing a two dimensional 
Image for storage In a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; means for 
selecting a first scan line in a given area of said 
stored two dimensional image; 

means for selecting a second scan line 
substantially parallel to said first scan line in said 
given area of said stored two dimensional image; 

means for calculating the cross-correlation 
functbn of said selected first scan line and sakI 
selected second scan line; and 

means for detecting the peak of said cross- 
correlation function of said first and second selec- 
ted scan lines, wherein the position of said peak 
of said cross-correlation lunctton of said selected 
first and second scan lines corresponds to the 
orientation of said barcode Image, 

37. An apparatus in accordance with claim 36, further 
comprising: 

means for shifting said selected second 
scan line so as to be aligned with sakl selected 
first scan line In accordance with said defected 
peak of said cross-correlation function of saki 
selected first and second scan lines. 

38. An apparatus in accordance with claim 36, for 
detenmining the orientation of a bar code symbol 
further comprising: 

means for sele^ng a plurality of scan lines 
in said given area of said stored two dimensional 
image; and 

means for calculating the respective 
cross-correlation function of selected pairs of 
selected scan lines from saU plurality of said 
selected scan lines. 

50 39. An apparatus in accordance with claim 38, further 
comprising: 

means for shifting said selected plurality of 
scan lines respectively so as to be aligned. 

55 40. An apparatus In accordance with daim 39, further 
comprising: 

means for filtering said bar code Image by 
taking the average of corresponding data points 



28. A method in accordance with claim 27, further 
comprising: 

^ shifting said selected second scan line so io 
as to*be alined with said selected first scan line 
In accordance with said detected peak of said 
cross-correlation function of said selected first 
and second scan lines. 

15 

29. A method in accordance with daim 27 or 28, for 
detemiining the orientation of a bar code symbol 
further comprising: 

seleding a plurality of scan lines In said 
given area of said stored two dimensional image; 20 
and 

calculating the respective cross-corre- 
lation function of selected pairs of selected scan 
lines finom said plurality of selected scan lines. 

26 

30. A method in accordance with claim 29, further 
comprising: 

shifting said selected plurality of scan lines 
respectively so as to be aligned. 

30 

31. A method in accordance witti claim 30, further 
comprising: 

filtering said bar code image by taking the 
average of corresponding data points from said 
plurality of shifted and selected scan lines. ss 

32. A method in accordance with daim 30, furtiier 
comprising: 

filtering said bar code Image by taking the 
median of corresponding data points of said 40 
plurality of shifted and selected scan lines. 

33. A nnetiiod In accordance witfi daim 30, further 
comprising: 

filtering said bar code Image by taking the 45 
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from said pluraJi^ of shifted and selected scan 
lines. 

41. An apparatus in accordance with claim 39, further 
comprising: 5 

means for filtering said barcode Image by 
taldng the ntedian of corresponding data points of 
said plurality of shifted and selected scan lines. 

4Z An apparatus in accordance with daim 39, further io 
oomprteing: 

means forfiltering said barcode image by 
taking the weighted average of corresponding 
data points of said plurality of shifted and selected 
scan lines, said average being weighted accord- is 
ing to the magnitude of said cross-correlation 
function between said plurality of said respective 
selected scan lines. 

43. An apparatus in accordance with claim 38 or 39. 20 
further comprising: 

means forfiltering said barcode Image by 
combining corresponding data points of said shif- 
ted and selected plurality of scan lines. 

25 

44. An apparatus in accordance with claim 43, ftirther 
comprising: 

means for converting said filtered barcode 
Image to a binary function using the average 
value of said combined shifted and selected 30 
plurality of scan lines as the binary threshold 
value. 
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